Some of the added files are quite big (74Mb). We try to keep the repo as small as possible and we would prefer files of size under 1Mb. Would it be possible for you to reduce the files size by subsampling the data? Thanks.

@mikecooke77 This is the PR with the large size of testing data to be trimmed. Please let us know if you find anything regarding similar tests for RTTOV.

@mikecooke77 This is the PR with the large size of testing data to be trimmed. Please let us know if you find anything regarding similar tests for RTTOV.

I think there is a similarly large file for RTTOV in https://github.com/JCSDA-internal/ufo-data/tree/feature/cmatrix_crtm/testinput_tier_1/resources/auxillary

e.g. mtgirs_cmatrix_and_bias

I think both of these files should be stored on git lfs not git. Therefore I would suggest adding both to:

https://github.com/JCSDA-internal/ufo-data/blob/feature/cmatrix_crtm/.gitattributes

You can just add the full filename. Then you will want to renormalize the repo e.g.

git add --renormalize .

@mikecooke77 agree with putting the file in git-lfs

@karpob will do this tomorrow if you don't beat us to it. @rajichidamb added you as a reviewer

@rajichidamb thanks! I was literally just about to look at this.

@rajichidamb thanks! I was literally just about to look at this.

Please feel free to fix if I missed anything.

@rajichidamb thanks! I was literally just about to look at this.

Please feel free to fix if I missed anything.

Looks good to me!

@mikecooke77 we took your advice and put the files in git-lfs can you confirm on your end that all looks correct,,, thx

tests are passing with this and associated UFO PR, locally using spack-stack v1.8 and gnu compilers

(venv) benr@jedi-wheels:~/work/JCSDA/JEDI/jedi-localhost-gnu/build/ufo$ ctest -R reconrad
Test project /home/benr/work/JCSDA/JEDI/jedi-localhost-gnu/build/ufo
    Start 836: ufo_test_tier1_test_ufo_iasi_crtmreconrad_linop_check
1/2 Test #836: ufo_test_tier1_test_ufo_iasi_crtmreconrad_linop_check ........   Passed    2.71 sec
    Start 837: ufo_test_tier1_test_ufo_iasi_crtmreconrad_linop_tlad_check
2/2 Test #837: ufo_test_tier1_test_ufo_iasi_crtmreconrad_linop_tlad_check ...   Passed    9.07 sec

100% tests passed, 0 tests failed out of 2

Label Time Summary:
crtm         =  11.78 sec*proc (2 tests)
mpi          =  11.78 sec*proc (2 tests)
operators    =  11.78 sec*proc (2 tests)
script       =  11.78 sec*proc (2 tests)
ufo          =  11.78 sec*proc (2 tests)

Total Test time (real) =  11.86 sec

@rajichidamb can you check with @eap about the potential impact on our git-lfs quota and if this is substantial enough to change course